Apparatus and method of monitoring moving objects

ABSTRACT

In a monitoring apparatus, a monitoring area is scanned by an area sensor device to detect objects. Moving objects are identified among the detected objects, and, among the identified moving objects, a moving object which is the closest to a priority monitoring object which is preset in the monitoring area is set as a tracking target. The object which is set to be tracked is automatically tracked by a camera device. As a result, even if there are present a plurality of moving objects in the monitoring area, tracking targets are switched from one to another, so that it is possible to set a moving object desired by an observer.

TECHNICAL FIELD

The present invention relates to an apparatus and method of monitoring amoving object with automatically tracking the moving object withinmonitoring area.

BACKGROUND ART

There has been known a system that detects a moving object andcontinuously images the detected moving object. In this system, an areasensor device such as a laser distance meter is used to scan amonitoring area to detect a moving object and a camera device is used soas to track the detected moving object so that the moving object iscontinuously imaged. For example, Patent Literature 1 discloses asecurity system that turns a camera device so as to track an intruder,during which image data monitoring the intruder are obtained.

CITATION LIST Patent Literature

[PTL 1] JP Patent No. 3011121

SUMMARY OF INVENTION Technical Problem

Conventionally, it is general that the monitoring area is set to have acertain level of wide which can be covered by a photographable range ofa camera device incorporated in the system. When the camera deviceoperates to cover the whole monitoring area, it is often difficult toimage, in a distinguishable manner, each moving object present in thearea. Nonetheless, it is required that the monitoring apparatus monitorsall moving objects which are present in the monitoring area, withoutfailure. For this reason, if a plurality of moving objects are detectedat the same time, it is required to select a moving object among theplurality of moving objects and switch over moving objects beingtracked.

However, in system shown in the foregoing Patent Literature 1, since itis not assumed that there are present a plurality of moving objects atthe same time, the system cannot select and set a moving object beingtracked. In addition, the system cannot switch over moving objects fromone to another to track such objects. In this system, it can be easilyconceived of sequentially switch over objects being tracked. However,simply switching over such objects may cause a state where an objectdesired by an observer is not tracked. In this case, a purpose given tothe monitoring apparatus, that is automatic tracking of moving objectsin such a manner that the moving objects are tracked independently ofeach other, may not be realized sufficiently. Simple switchovers amongthe objects being tracked may fail to reliably track all the movingobjects present in the monitoring area at the same time, which mightalso be led to an insufficient monitoring performance (i.e., a decreaseof monitoring performance).

The present invention has been made with consideration of the foregoingsituations, and it is a first object to provide a method of controllingthe monitoring apparatus which is able to switch objects being trackedand set an observer's concerned moving object to a tracking targetreliably, even if there are a plurality of moving objects in amonitoring area at the same time.

The present invention has been made with consideration of the foregoingsituations, and it is a second object to provide a method of controllingthe monitoring apparatus which is able to, in addition to the firstobject, without fail, check how moving objects are in a monitoring areaeven if there are a plurality of moving objects in the monitoring areaat the same time.

Advantageous Effects of Invention

In order to accomplish the first object, in a first aspect of thepresent invention, a monitoring area is scanned by an optical distancemeter to detect objects, and moving objects are identified among thedetected objects. Further, among the moving objects, a moving objectwhich is positionally the closest to a priority monitoring object whichis preset in the monitoring area is set as a tracking targetautomatically. The moving object which has been set as the trackingtarget is tracked automatically by a camera device.

Since the monitoring area is set to have a certain degree of size asreferred above, a probability that a plurality of moving objects arepresent in the monitoring area at the same time becomes higher. In thiscase, when a single moving object is automatically tracked during whichmovements of the tracked moving objects are checked with enlargedimages, other moving objects are not monitored. Hence, in such asituation, it is quite difficult to monitor in parallel all the movingobjects without fail.

With consideration of such a situation, a moving object which ispositionally the closest to a priority monitoring object is set as atracking target. The priority monitoring object is a place (orsubstance) which should be monitored with a top priority. As a result, amoving object desired by an observer can be as a tracking target. Thisway of setting the tracking target makes it possible that, when themoving objects are moved and their positional relationships are changed,objects being tracked can be switched automatically and appropriately.And, in response to movements of the moving objects, a tracking targetcan be switched in turn to another one, whereby the moving objects inthe monitoring area can be monitored without fail, and the monitoringapparatus can provide its full performance.

In order to accomplish the second object, a second aspect of the presentinvention provides a technique of monitoring a moving object, by which amonitoring area is scanned by an optical distance meter to detect movingobjects, a moving object is identified among the detected movingobjects, and the identified moving object is set to a tracking targetfor automatic tracking by a camera device. When a plurality of themoving objects are identified in the monitoring area and it isdetermined that a tracking release condition is met which is preset forreleasing the automatic tracking performed using the camera device, thecamera device monitors, in fixed-point monitoring, a priority monitoringarea at a wide view angle, the priority monitoring area being preset inthe monitoring area to contain a priority monitoring object present inthe monitoring area.

Since the monitoring area is set to have a certain degree of size asreferred above, a probability that a plurality of moving objects arepresent in the monitoring area at the same time becomes higher. In thiscase, when a single moving object is automatically tracked during whichmovements of the tracked moving objects are checked with enlargedimages, other moving objects are not monitored. Hence, in such asituation, it is quite difficult to monitor in parallel all the movingobjects without fail.

With consideration of such a situation, in a case where a plurality ofmoving objects are identified among the detected objects, a prioritymonitoring area is fixed-point-monitored at a wide view angle. Thismakes it possible that how the moving objects move in the prioritymonitoring area and its associated conditions are checked. That is, evenif a plurality of moving objects are present in the monitoring area,conditions in the monitoring area, such as movements of the movingobjects in the monitoring area and where such moving objects are locatedin the monitoring area, can be observed without fail.

BRIEF DESCRIPTION OF DRAWINGS

In the accompanying drawings:

FIG. 1 is a block diagram illustrating the configuration of a monitoringapparatus according to a first embodiment;

FIG. 2 is an illustration illustrating a mentoring area which is an areabeing monitored by the monitoring apparatus;

FIG. 3 is a flowchart showing a monitoring process performed by themonitoring apparatus;

FIG. 4 is a flowchart showing a determination process performed by themonitoring apparatus;

FIG. 5 is an illustration illustrating a positional relationship amongmoving objects at a time instant t1;

FIG. 6 is an illustration illustrating a positional relationship amongthe moving objects at a time instant t2;

FIG. 7 is an illustration illustrating a positional relationship amongthe moving objects at a time instant t3;

FIG. 8 is an illustration illustrating a positional relationship amongthe moving objects in the monitoring area;

FIG. 9 is an illustration illustrating a priority monitoring area lowhich is set in the monitoring area;

FIG. 10 is a flowchart showing a monitoring process performed by amonitoring apparatus according to a second embodiment;

FIG. 11 is an illustration illustrating a positional relationship amongmoving objects in a monitoring area;

FIG. 12 is an illustration illustrating a positional relationship amongthe moving objects at a time instant t1;

FIG. 13 is an illustration illustrating a positional relationship amongthe moving objects at a time instant t2;

FIG. 14 is an illustration illustrating a positional relationship amongthe moving objects at a time instant t3;

FIG. 15 is an illustration illustrating a positional relationship amongthe moving objects and an priority monitoring area set in the monitoringarea, at a time instant t3 and thereafter;

FIG. 16 is a block diagram illustrating the configuration of amonitoring apparatus according to a third embodiment;

FIG. 17 is a flowchart showing a monitoring process performed by themonitoring apparatus; and

FIG. 18 is a flowchart showing a monitoring process performed by amonitoring apparatus according to a fourth embodiment.

DESCRIPTION OF EMBODIMENTS

Referring now to the accompanying drawings, various embodiments of thepresent invention will now be described. In the respective embodiments,components which are substantially in common are given the samereference numerals so that redundant explanations are omitted.

First Embodiment

With reference to FIGS. 1 to 9, a first embodiment of the presentinvention will now be described.

As shown in FIG. 1, there is provided a monitoring apparatus that adoptsa control method of the present embodiment, in which the monitoringapparatus 1 is provided with an area sensor device 2, a camera device 3,and a monitoring unit 4.

As shown in FIG. 1, the area sensor device 2 includes a controller 10, astorage unit 11, an input/output unit 12, a laser scanner 13, an objectdetecting section 14, a moving object identifying section 15, a movingobject counting section 16, a tracking target setting section 17, andother necessary components. The controller 10 is configured by amicrocomputer that has a central processing unit (CPU), a read-onlymemory (ROM), a random access memory (ROM), and the like (not shown).The controller 10 controls the laser scanner 13 and the like by runningcomputer programs stored in the storage unit 11 and the like. Accordingto the present embodiment, the object detecting section 14, the movingobject identifying section 15, the moving object counting section 16,and the tracking target setting section 17 are actualized as software bythe computer programs run by the controller 10. The area sensor device 2corresponds to an optical distance meter in the scope of claims.

The storage unit 11 is configured by a memory device or the like (notshown). The storage unit 11 stores therein various types of informationsuch as computer programs, as well as measurement results such as thedetection distance and the detection angle of a detected object. Theinput/output unit 12 functions as an input and output means forreceiving input of command signals from high-order control devices (notshown), outputting notifications of detection results regarding objects,and the like.

The laser scanner 13 includes a laser radiating device 13 a, a mirror 13b, a motor 13 c, and a laser light receiving device 13 d. The mirror 13b reflects laser light irradiated from the laser radiating device 13 atowards a monitoring area and receives light reflected by an objectwithin the monitoring area. The motor 13 c rotatably drives the mirror13 b at an angular resolution and a scanning cycle determined inadvance. The laser light receiving device 13 d receives the reflectedlight. This configuration is an example. A configuration that drives thelaser radiating device 13 a (a configuration in which the reflectionmirror 13 b is not used during radiation) is also possible. As a resultof the laser radiating device 13 a irradiating laser light and the motor13 c to rotatably driving the mirror 13 b, the laser light is irradiatedwithin a scanning area R0 in a predetermined scanning direction, such asthat indicated by arrow A (a counter-clockwise direction from a planarperspective in FIG. 2). The reflected light that is reflected by amoving object (such as a moving object M1 in FIG. 2) present within thescanning area R0 is received by the laser light receiving device 13 d.

The object detecting section 14 detects an object, as is well known,based on the distance (above-described detection distance) and thescanning angle (above-described detection angle) when the reflectedlight is received by the laser light receiving device 13 d. The movingobject identifying section 15 identifies whether or not the object is amoving object based on changes over time. The changes over time refer tothe changes in the detection distance and the detection anglecorresponding to the detected object over a plurality of scanningoperations.

The moving object counting section 16 identifies the number of movingobjects identified by the moving object identifying section 15. Thetracking target setting section 17 sets any of the moving objects, whena plurality of moving objects are identified, as a tracking target(i.e., a target being tracked). According to the present embodiment, thetracking target setting section 17 sets, as the tracking target, themoving object closest to a priority monitoring target, among theplurality of moving objects. The priority monitoring target is setwithin a monitoring area R1 (an entrance/exit G, according to thepresent embodiment). Position information on the moving object set asthe tracking target (i.e., the target which should be tracked) istransmitted to the camera device 3. The position information includesthe distance to the moving object determined from the detectiondistance, and an angle determined from the detection angle.

The camera device 3 includes an imaging camera 20 and a movable mount21. As shown in FIG. 2, the imaging camera 20 is provided with aso-called zoom function that allows the angle of view (field of view) tobe changed from an angle of view α to an angle of view β. At the angleof view α, an image in which the moving object is identifiable can becaptured. At the angle of view β, the overall monitoring area R1 iscaptured. Here, “the moving object is identifiable” means that, if themoving object is a person, for example, the face can be recognized. Ifthe moving object is a vehicle, the vehicle model, the license plate,the face of the driver, or the like can be recognized.

Therefore, when an image is captured at the angle of view α, forexample, the face of a person can be recognized from the captured image(including still image and video image). Meanwhile, when an image iscaptured at the angle of view β, identification of individual movingobjects (such as recognition of the face of a person) is slightlydifficult. However, at least the presence of the moving object can begrasped. Furthermore, for example, the outer appearance of the movingobject can be roughly recognized.

The imaging camera 20 is attached to the movable mount 21. The imagingcamera 20 is aimed towards the direction in which the moving object setas the tracking target is present, based on the position information ofthe moving object acquired from the area sensor device 2. In addition,zoom function control of the imaging camera 20 is performed. Thedirection of the imaging camera 20 and the zoom function are controlledeach time the position of the moving object changes. Tracking themovement of the moving object and capturing an image of the movingobject in this way corresponds to automatic tracking.

The monitoring unit 4 includes a display 30. The monitoring unit 4displays the image captured by the camera device 3. The monitoring unit4 is provided in a security room (not shown), for example, and ismonitored by a security guard or the like.

Next, a control method for performing automatic tracking of a movingobject will be described.

The monitoring apparatus 1 performs a monitoring process shown in FIG.3. When the monitoring process is started, first, the monitoringapparatus 1 initializes a tracking period, a determination period, andvariables M and N (A1). Although details will be described hereafter,the definition of each field is as follows.

-   -   Tracking period: The tracking period refers to a period from        when the tracking target is set until the next tracking target        is set. That is, the tracking period refers to the period until        the tracking target is switched. The tracking period corresponds        to a “period during which the same moving object is        automatically tracked”. The tracking period includes a period        during which the direction of the imaging camera 20 is changed        and a period during which the zoom function is controlled.    -   Determination period: The determination period is set in        advance.    -   Variable M: The variable M is used to count the number of times        the tracking target is switched during the determination period.        As described hereafter, when the value of the variable M exceeds        a determination upper-limit count determined in advance, a        determination is made that the field of view of the imaging        camera 20 is frequently switched.    -   Variable N: The variable N is used to count the number of times        the tracking period falls below a lower limit value. As        described hereafter, when the value of the variable N reaches a        lower-limit determination count (three times according to the        present embodiment) or higher, a determination is made that the        field of view of the imaging camera 20 is frequently switched in        a state in which the moving object cannot be identified. The        lower limit value is set taking into consideration the period        during which the direction of the imaging camera 20 is changed,        the period during which the zoom function is controlled, and a        period that is expected to be required to identify a moving        object from an image (such as a period required for the security        guard to recognize the face of a person).

Next, the monitoring apparatus 1 scans the monitoring area R1 using thearea sensor device 2 (A2). The monitoring apparatus 1 thereby detectsobjects within the monitoring area R1 and identifies moving objects(A3). The monitoring apparatus 1 sets the moving object closest to thepriority monitoring target (the entrance/exit G) as the tracking target(A4). At this time, when a plurality of moving objects M10 and M11 areidentified within the monitoring area R1 (including the region) at timet1, as shown in FIG. 5, the monitoring apparatus 1 automatically tracksthe moving object M10 closest to the entrance/exit G. FIG. 5schematically indicates the moving object with the symbol ∘ (circle).The time at which the moving object is identified is indicated bycharacters (“t1” in FIG. 5) inside the symbol. This similarly applies toFIG. 6, FIG. 7, and the like, described hereafter.

In other words, the monitoring apparatus 1 sets the tracking targetgiving preference to the moving object closest to the prioritymonitoring target. As a result, the monitoring apparatus 1 sets thedesired moving object that an observer, such as the security guard,should monitor as the tracking target. At step A4, when a single movingobject is identified, this moving object is set as the tracking target,as the moving object closest to the entrance/exit G.

After setting the tracking target, the monitoring apparatus 1 performs adetermination process (A5). In the determination process, as describedhereafter, the monitoring apparatus 1 determines whether or not atracking release condition has been met, based on the frequency ofswitching of the tracking target. The tracking release condition is usedto release automatic tracking. A reason for this is that, when thetracking target is frequently switched, identification of the movingobject becomes difficult because the field of view of the camera device1 is also frequently switched. Therefore, in the determination process,the monitoring apparatus 1 determines whether or not to releaseautomatic tracking.

At this time, the monitoring apparatus 1 determines the frequency oftracking target switching based on the following determination criteria.

-   -   Determination criterion A: The number of times (i.e., count) the        tracking target is switched during the determination period        determined in advance exceeds the determination upper-limit        count.    -   Determination criterion B: The consecutive number of times that        the tracking period during which the same moving object is        automatically tracked falls below the lower limit value is the        lower-limit determination count or more. According to the        present embodiment, whether or not the tracking period        consecutively falls below the lower limit value three times is        determined.

The determination process is performed as a part of the monitoringprocess flow, as shown in FIG. 3. However, to simplify the description,the flow of the processes for the determination criterion A and thedetermination criterion B will be collectively described herein.

<Regarding Determination Criterion A>

In the determination process, the monitoring apparatus 1 determineswhether or not the tracking target has been switched (B1). Whendetermined that the tracking target has not been switched (NO at B1),the monitoring apparatus 1 determines whether or not the variable M hasexceeded the determination upper-limit count (B2). The monitoringapparatus 1 increments the variable M each time the tracking target isswitched during a predetermined period (YES at B1, B4). Meanwhile, themonitoring apparatus 1 initializes the variable M after the elapse ofthe determination period (YES at step A9, A10 in FIG. 3). Therefore, thenumber of times (i.e., count) the tracking target has been switched,that is, the number of times the field of view of the imaging camera 20has been switched can be grasped the value of the variable M beingreferenced.

When determined that the variable M has exceeded the determinationupper-limit count (YES at B2), the monitoring apparatus 1 considers thefield of view of the imaging camera 20 to be frequently switched, anddetermines that the tracking release condition for releasing automatictracking is met (B9). Meanwhile, when determined that the variable M hasnot exceeded the determination upper-limit count (NO at B2), themonitoring apparatus 1 considers the field of view of the imaging camera20 to not be frequently switched, and determines that the trackingrelease condition is not met (B3). In this way, the monitoring apparatus1 determines whether or not to release automatic tracking based on thedetermination criterion A.

<Regarding Determination Criterion B>

When determined that the tracking target has been switched (YES at B1),after incrementing the above-described variable M (B4), the monitoringapparatus 1 determines whether or not the tracking period falls belowthe lower limit value (B5). The monitoring apparatus 1 initializes thetracking period each time automatic tracking is started (step A8 in FIG.3). The tracking period refers to the period elapsed from when themoving object set as the tracking target has previously beenautomatically tracked until the current point in time (the period duringwhich the same moving object is automatically tracked).

When determined that the tracking period has not fallen below the lowerlimit value (NO at B5), the monitoring apparatus 1 considers theprevious automatic tracking to have been performed over the periodrequired for identifying the moving object and sets the variable N to 0(B6). Meanwhile, when determined that the tracking period falls belowthe lower limit value (YES at B5), the monitoring apparatus 1 considersthe previous automatic tracking to not have been performed over theperiod required for identifying the moving object, and increments thevariable N (B7).

After repeatedly performing the determination process, when determinedthat the state in which the tracking period falls below the lower limitvalue (the state in which the variable N is not set to 0) continuouslyoccurs and the variable N becomes three (lower-limit determinationcount) or more (YES at B8), the monitoring apparatus 1 considers that aperiod sufficient for identifying a moving object is not secured. Themonitoring apparatus 1 determines that the tracking release conditionfor releasing automatic tracking is met (B9). When determined that thevariable N is less than three (NO at B8), the monitoring apparatus 1proceeds to step B2.

In this way, the monitoring apparatus 1 determines whether or not torelease automatic tracking in the determination process. The monitoringapparatus returns to the monitoring process based on the determinationresult.

After returning from the determination process, the monitoring apparatus1 determines whether or not the tracking release condition is met (A6).When determined that the tracking release condition is not met (NO atA6), the monitoring apparatus 1 automatically tracks the tracking targetset at step A4 (A7). The monitoring apparatus 1 initializes the trackingperiod (A8). Then, when determined that the determination period haselapsed (YES at A9), the monitoring apparatus 1 initializes thedetermination period and the variable M (A10). The monitoring apparatus1 then proceeds to step A2. Meanwhile, when determined that thedetermination period has not elapsed (NO at A9), the monitoringapparatus 1 directly proceeds to step A2).

When the state at time t1 shown in FIG. 5 changes to the state at timet2 shown in FIG. 6, a plurality of moving objects M10, M11, and M12 areidentified within the monitoring area R1 (including the region).Therefore, the monitoring apparatus 1 sets the moving object (the movingobject M10 in this case as well) closest to the entrance/exit G as thetracking target and starts automatic tracking. In this case, the movingobject M10 is continuously automatically tracked from the state at timet1. Therefore, in the determination process described above, themonitoring apparatus 1 determines that the tracking target is notswitched.

Then, when a plurality of moving objects M10, M11, M12, and M13 areidentified within the monitoring area R1 (including the region) at timet3 as shown in FIG. 7, the monitoring apparatus 1 sets the moving object(the moving object M11 in this case) closest to the entrance/exit G asthe tracking target and starts automatic tracking. In this case, in thedetermination process, the monitoring apparatus 1 determines whether ornot the tracking period falls below the lower limit value because thetracking target is switched.

For example, a situation is premised such as that shown in FIG. 8. Here,a plurality of moving objects are identified within the monitoring areaR1 and the movable objects move during a short period of time. Thissituation corresponds, for example, to a situation in which the movingobjects (such as people) enter and exit the entrance/exit G during ashort period of time, such as at the start or end of the work day.

In this case, the monitoring apparatus 1 sets the moving object closestto the entrance/exit G as the tracking target. Therefore, the monitoringapparatus 1 initially automatically tracks a moving object Ma1. When themoving object Ma1 moves and a moving object Ma2 newly becomes closest tothe entrance/exit G, the monitoring apparatus 1 automatically tracks themoving object Ma2, as shown in FIG. 8. Furthermore, when time elapsesand, for example, a moving object Ma4 newly infiltrates the monitoringarea R1 and becomes closest to the entrance/exit G, the monitoringapparatus 1 sets the moving object Ma4 as the tracking target.

Therefore, in a situation in which the moving objects concentrate nearthe entrance/exit G during a short period of time and the moving objectclosest to the entrance/exit G frequently changes, the field of view ofthe imaging camera 20 is frequently switched when the tracking target isautomatically tracked. Identification performance for the moving objectdecreases. In other words, monitoring may become insufficient.

When the moving object closest to the entrance/exit G frequently changesin this way, the tracking target is frequently switched during thedetermination period. Instances in which the tracking periodcontinuously falls below the lower limit value increases. In otherwords, in the state shown in FIG. 8, the likelihood of theabove-described determination criterion A or determination criterion Bbeing met increases. When the determination criterion A or thedetermination criterion B is met (YES at step B2 or YES at step B8,described above), the monitoring apparatus 1 determines that thetracking release condition is met.

Therefore, in the monitoring process shown in FIG. 3, when determinedthat the tracking release condition is met (YES at A6), the monitoringapparatus 1 performs fixed-point monitoring by enlarging a prioritymonitoring area R2 set in advance within the monitoring area R1, asshown in FIG. 9 (A11). The priority monitoring area R2 is an areaincluding the entrance/exit G, which is the priority monitoring target,and is set near the entrance/exit G. According to the presentembodiment, the priority monitoring area R2 is approximately set to asize enabling a plurality of moving objects to be imaged at the sametime. If the moving objects are presumed to be people, the prioritymonitoring area R2 is approximately set such that three to four peoplecan be imaged from head to toe. The angle of view of the imaging camera20 at this time is greater than the angle of view α and no greater thanthe angle of view β. That is, in the fixed-point monitoring state, aplurality of moving objects near the entrance/exit G are captured withina single image in the image of the priority monitoring area R2. Inaddition, the direction of the imaging camera 20 is fixed. The imagingcamera 20 does not track the movements of the moving objects. In otherwords, automatic tracking of the moving object is released.

As a result, even when the moving objects are concentrated at theentrance/exit G during a short period of time, the vicinity of theentrance/exit G to be preferentially monitored can be monitored. Themonitoring apparatus 1 continues fixed-point monitoring until afixed-point monitoring period, determined in advance, ends (NO at A12,then proceeds to step A11). Therefore, switching of the field of viewimmediately after the start of fixed-point monitoring is prevented.

In the control method according to the present embodiment, describedabove, the following effects are achieved.

Among the moving objects present within the monitoring area R1, themoving object closest to the priority monitoring target (theentrance/exit G, according to the present embodiment) is set as thetracking target. The camera device 3 automatically tracks the trackingtarget. Therefore, the moving object closest to the location to bepreferentially monitored, that is, the moving object desired as amonitoring target by the observer can be set as the tracking target.

At this time, the moving object closest to the priority monitoringtarget is set as the tracking target. Therefore, even when the movingobject moves and the positional relationship changes, the trackingtarget can be automatically and appropriately switched. In addition,even when a plurality of moving objects are present within themonitoring area, the tracking target is successively switched inaccompaniment with the movements of the moving objects. Therefore, eachof the moving objects within the monitoring area can be monitored.

When the number of times (i.e., count) that the tracking period duringwhich the same moving object is automatically tracked continuously fallsbelow the lower limit value reaches the lower-limit determination countor higher, that is, when the field of view of the camera device 3frequently changes before a moving object is identified, the prioritymonitoring area R2 is enlarged and fixed-point monitoring is performedby the camera device 3. As a result, the field of view of the cameradevice 3 is fixed, and the moving object can be identified.

When the number of times that the tracking target is switched during thedetermination period exceeds the determination upper-limit valuedetermined in advance, that is, when the field of view of the cameradevice 3 frequently changes, the priority monitoring area R2 is enlargedand fixed-point monitoring is performed by the camera device 3. As aresult, the field of view of the camera device 3 is fixed, and themoving object can be identified.

At this time, the priority monitoring area R2 is set to an areaincluding the priority monitoring target. In other words, fixed-pointmonitoring is performed in a state in which the priority monitoringtarget is within the field of view. Therefore, the risk of decrease inmonitoring performance can be suppressed.

The priority monitoring area R2 is set to a size enabling a plurality ofmoving objects to be imaged. That is, the priority monitoring area R2 isset to a size such as to place importance on the identification ofmoving objects within the priority monitoring area R2. Therefore, aplurality of moving objects present near the priority monitoring area R2can be identified even during fixed-point monitoring. As a result, therisk of decrease in identification performance can be suppressed.

The camera device 3 is provided with the zoom function. Therefore, inthis case, when importance is placed on whether or not a moving objectis present near the priority monitoring target, the size of the prioritymonitoring area can be made larger than that according to the presentembodiment. That is, the size of the priority monitoring area R2 can beset as appropriate based on what the observer considers important.

Second Embodiment

A control method according to a second embodiment of the presentinvention will hereinafter be described with reference to FIG. 10 toFIG. 15. The second embodiment differs from the first embodimentregarding the moving object to be set as the tracking target when aplurality of moving objects are identified. The configuration of themonitoring apparatus is the same as that according to the firstembodiment. Therefore, the monitoring apparatus is described using thesame reference numbers. In addition, detailed descriptions of processesin the monitoring process shown in FIG. 10 that are the same as those inthe monitoring process according to the first embodiment shown in FIG. 3are omitted.

The monitoring apparatus 1 performs the monitoring process shown in FIG.10. The monitoring apparatus 1 initializes the tracking period, thedetermination period, and the variables M and N (C1). Thereafter, themonitoring apparatus 1 scans the monitoring area R1 using the areasensor device 2 (C2). The monitoring apparatus 1 detects objects withinthe monitoring area R1 and identifies moving objects (C3). Next, themonitoring apparatus 1 sets the newest moving object or an untrackedmoving object as the tracking target (C4). The newest moving objectherein refers to the newest identified moving object among the movingobjects newly identified within the monitoring area R1. In other words,upon newly identifying a moving object within the monitoring area R1,that is, upon infiltration of a new moving object into the monitoringarea R1, the monitoring apparatus 1 sets this moving object as thetracking target.

Meanwhile, the untracked moving object refers to a moving object thathas not yet been set as the tracking target, among the newly identifiedmoving objects. When a plurality of moving objects are newly identifiedwithin the monitoring area R1, the monitoring apparatus 1 is required toselect and set any of the moving objects as the tracking target. When aplurality of moving objects are newly identified, the monitoringapparatus 1 according to the present embodiment preferentially sets amoving object near the border of the monitoring area R1 as the trackingtarget. Therefore, when a plurality of moving objects are identified atthe same time, a moving object that has not been set as the trackingtarget is present within the monitoring area R1. Therefore, when anuntracked moving object is present, the monitoring apparatus 1 sets thismoving object as the tracking target.

As a result of the newest moving object or an untracked moving objectbeing set as the tracking target in this way, each moving object thathas infiltrated the monitoring area R1 can be automatically tracked

After setting the tracking target, the monitoring apparatus 1 determineswhether or not the response time is longer than a predicted time (C5).Here, the response time refers to the amount of time required until themoving object newly set as the tracking target is automatically tracked.The predicted time is the predicted amount of time required for themoving object to reach the priority monitoring target (the entrance/exitG). Specifically, for example, as shown in FIG. 11, a moving object Mb1is first identified on the left end side of the monitoring area R1 inFIG. 11. Then, in a state in which the moving object Mb1 is beingautomatically tracked, a moving object Mb2 is identified.

In this case, to monitor the moving object Mb2, the direction of theimaging camera 20 is required to be moved from the left end side to theright end side in FIG. 11. The zoom function is required to becontrolled such that the imaging camera 20 focuses on the moving objectMb2. The moving object is then required to be identified from thecaptured image. The amount of time required for this operation is theresponse time. In addition, the predicted amount of time required forthe moving object Mb2 to reach the entrance/exit G is the predictedtime. The size of the monitoring area R1 and the position of theentrance/exit G are determined in advance. In addition, the distancebetween the moving object Mb2 and the entrance/exit G can be determinedfrom the position information. Therefore, the response time and thepredicted time can be calculated based on these pieces of information.

When determined that the response time is shorter than the predictedtime (NO at C5), in a manner similar to that according to the firstembodiment, the monitoring apparatus 1 performs the determinationprocess shown in FIG. 4 (C6). When determined that the tracking releasecondition is not met (NO at C7), the monitoring apparatus 1automatically tracks the tracking target (C8). Subsequently, themonitoring apparatus 1 initializes the tracking period (C9). Whendetermined that the determination period has not elapsed (NO at C10),the monitoring apparatus 1 proceeds directly to step C2. When determinedthat the determination period has elapsed (YES at C10), the monitoringapparatus 1 initializes the determination period and the variable M(C11). The monitoring apparatus 1 then proceeds to step C2. Themonitoring apparatus 1 repeatedly performs identification of movingobjects, setting of the tracking target, the determination process, andthe like.

In the control method according to the present embodiment as well, thefield of view of the imaging camera 20 may be frequently switched. Areason for this is as follows. In other words, the number of imagingcameras 20 that are installed and the like are set based on the setupstate of the monitoring apparatus 1, that is, the approximate number ofmoving objects premised. However, when a number of moving objectsexceeding the premised number is present, for example, automatictracking may be delayed. For example, as shown in FIG. 12, at time t1 atwhich a moving object M20 is being automatically tracked, a movingobject M21 is newly identified. In this case, the monitoring apparatus 1sets the moving object M20 as the tracking target and automaticallytracks the moving object M21. Then, at time t2 as shown in FIG. 12, amoving object M22 is newly identified. The monitoring apparatus 1 setsthe moving object M22 as the tracking target and automatically tracksthe moving object M22. Subsequently, at time t3 as shown in FIG. 14, amoving object M23 is newly identified. The monitoring apparatus 1 setsthe moving object M23 as the tracking target and automatically tracksthe moving object M23.

In this case, the monitoring apparatus 1 repeats the determinationprocess at step C6 each time the tracking target is set. Because thetracking target is switched, the monitoring apparatus 1 performs thedetermination based on the above-described determination criterion A anddetermination criterion B. Then, for example, when determined that thetracking release condition is met at time t3 shown in FIG. 14 (YES atC7), the monitoring apparatus 1 releases automatic tracking. Themonitoring apparatus 1 then performs fixed-point monitoring of thepriority monitoring area (the overall monitoring area R1, according tothe present embodiment) at a wide angle as shown in FIG. 15 (C12). Atthis time, the angle of view of the imaging camera 20 is the angle ofview β. In a manner similar to that according to the first embodiment,the priority monitoring area includes the entrance/exit G, which is thepriority monitoring target.

As a result, the presence of moving objects throughout the overallmonitoring area R1 can be grasped. In other words, even in a situationin which moving objects infiltrate the monitoring area R1 one after theother, monitoring can be performed such as to include the entrance/exitG that is to be preferentially monitored. In a manner similar to thataccording to the first embodiment, the monitoring apparatus 1 continuesfixed-point monitoring until a fixed-point monitoring period, determinedin advance, ends (NO at step C13, then proceeds to step C12).

In the control method according to the present embodiment, describedabove, the following effects are achieved.

Among the moving objects identified within the monitoring area R1, thenewest identified moving object is set as the tracking target. Thecamera device 3 automatically tracks the tracking target. Therefore, amoving object that has infiltrated the monitoring area R1, that is, themoving object that the observer desires to monitor can be set as thetracking target.

In addition, because the newest identified moving object is set as thetracking target, the moving object can be set as the monitoring targetat an early stage of infiltration. It is presumed that, based onstatistics, a certain period of time is required for the moving objectto reach a position that should actually be protected, such as thepriority monitoring target. Therefore, monitoring can be performed basedon many pieces of information (information acquired through imaging)using the tracking time to the fullest. Therefore, monitoring accuracycan be improved. The role as a monitoring apparatus can be sufficientlyfulfilled.

When a plurality of newly identified moving objects are present, themoving objects are set as the tracking target in order from that closeto the border of the monitoring area R1. The tracking target is thenautomatically tracked. This operation is repeatedly performed.Therefore, each moving object that has infiltrated the monitoring areaR1 can be set as the tracking target.

In this case, a moving object being close to the border of themonitoring area R1 means that the moving object can easily leave themonitoring area R1. Therefore, as a result of the moving object close tothe border of the monitoring area R1 being set as the tracking targetwhen a plurality of moving objects are identified, a moving object thatmay move outside of the monitoring area R1 can be preferentiallymonitored. As a result, even when a plurality of moving objects areidentified at the same time, a situation in which a moving object thathas infiltrated the monitoring area R1 leaves the monitoring area R1without being monitored can be prevented.

When the response time is longer than the predicted time, fixed-pointmonitoring of the priority monitoring area is performed at a wide angleby the camera device 3. Therefore, even when automatic tracking isdelayed, at least the moving objects can be imaged.

When the number of times that the tracking period during which the samemoving object is automatically tracked continuously falls below thelower limit value reaches the lower-limit determination count or higher,the priority monitoring area R2 is enlarged and fixed-point monitoringis performed by the camera device 3. Therefore, in a manner similar tothat according to the first embodiment, the field of view of the cameradevice 3 is fixed, and the moving objects can be identified.

When the number of times that the tracking target is switched during thedetermination period exceeds the determination upper-limit countdetermined in advance, the priority monitoring area R2 is enlarged andfixed-point monitoring is performed by the camera device 3. Therefore,in a manner similar to that according to the first embodiment, the fieldof view of the camera device 3 is fixed, and the moving objects can beidentified.

Because the priority monitoring area R2 is set to the overall monitoringarea R1, the overall monitoring area R1 can be monitored even duringfixed-point monitoring. The risk of decrease in monitoring performancecan be suppressed.

Third Embodiment

A control method according to a third embodiment of the presentinvention will hereinafter be described with reference to FIG. 16 andFIG. 17. The third embodiment differs from the second embodiment inthat, when fixed-point monitoring is performed at a wide angle, adesired moving object can be selected. Regarding the configuration ofthe monitoring apparatus, sections that are the same as those accordingto the first embodiment are described using the same reference numbers.In addition, detailed descriptions of processes in the monitoringprocess shown in FIG. 17 that are the same as those in the monitoringprocess according to the second embodiment shown in FIG. 10 are omitted.

As shown in FIG. 16, in the monitoring apparatus 1 according to thepresent embodiment, the monitoring unit 4 is provided with a targetselector 31. The target selector 31 is used to select any of the movingobjects, among the moving objects present within the monitoring area R1,as the tracking target. The target selector 31 is configured as an inputmeans, such as a mouse, a keyboard, or a touch panel, (not shown) inwhich a selection operation by the security guard or the like isinputted. Selection of the tracking target is performed by the desiredmoving object being selected from among the moving objects displayed inthe display 30 (image from the imaging camera 20). A process forselecting the tracking target will be described below.

The monitoring apparatus 1 performs a monitoring process shown in FIG.17. The monitoring apparatus 1 initializes the tracking period, thedetermination period, and the variables M and N (D1). Thereafter, themonitoring apparatus 1 scans the monitoring area R1 using the areasensor device 2 (D2). The monitoring apparatus 1 detects objects withinthe monitoring area R1 and identifies moving objects (D3). Next, themonitoring apparatus 1 sets the tracking target (D4). Here, themonitoring apparatus 1 may set the moving object closest to theentrance/exit G as the tracking target, as according to the firstembodiment. Alternatively, the monitoring apparatus 1 may set the newestmoving object as the tracking target, as according to the secondembodiment. The monitoring apparatus 1 may also set the moving objectswithin the monitoring area R1 in sequence or in a random manner.

Next, in a manner similar to that according to the first embodiment, themonitoring apparatus 1 performs the determination process shown in FIG.4 (D5). When determined that the tracking release condition is not met(NO at D6), the monitoring apparatus 1 automatically tracks the trackingtarget (D7). Subsequently, the monitoring apparatus 1 initializes thetracking period (D8). When determined that the determination period hasnot elapsed (NO at D9), the monitoring apparatus 1 proceeds directly tostep D2. When determined that the determination period has elapsed (YESat D9), the monitoring apparatus 1 initializes the determination periodand the variable M (D10). The monitoring apparatus 1 then proceeds tostep D2.

The monitoring apparatus 1 repeatedly performs identification of themoving objects and the determination process, such as shown in FIG. 12to FIG. 14 according to the second embodiment. When determined that thetracking release condition is met (YES at D6), the monitoring apparatus1 performs fixed-point monitoring of the priority monitoring area at awide angle, as shown in FIG. 15 (D11). According to the presentembodiment, the monitoring apparatus 1 sets the overall monitoring areaR1 as the priority monitoring area, in a manner similar to thataccording to the second embodiment.

Next, the monitoring apparatus 1 determines whether or not the trackingtarget is selected (D12). In this case, for example, when the targetselector 31 is configured by a touch panel, the desired moving objectcan be selected by any of the moving objects displayed in the display 30being selected by touch operation. Alternatively, moving objectidentifiers (IDs) (unique numbers assigned when the area sensor device 2identifies the moving objects) may be displayed in the display 30. Thedesired moving object ID may be selected using a keyboard or the like.In any case, any configuration is possible as long as the moving objectcan be selected.

When determined that the tracking target is selected (YES at D12), themonitoring apparatus 1 automatically tracks the selected tracking target(D7). At this time, fixed-point monitoring is released. Meanwhile, whendetermined that the tracking target is not selected (NO at D12), themonitoring apparatus 1 continues fixed-point monitoring until thefixed-point monitoring period ends (NO at D13, then proceeds to stepD11).

In this way, even when a plurality of moving objects are present in themonitoring area R1, the monitoring apparatus 1 can set the moving objectdesired by the observer as the tracking target.

In the control method according to the present embodiment describedabove, the following effects are achieved.

When a plurality of moving objects are identified within the monitoringarea R1, fixed-point monitoring of the priority monitoring area R2 isperformed at wide angle by the camera device 3 when the tracking releasecondition is met. Therefore, the moving objects within the prioritymonitoring area R2 can be imaged. As a result, even when a plurality ofmoving objects infiltrate the monitoring area R1, at least the movingobjects within the priority monitoring area R2 can be monitored.

In this case, as a result of the field of view being set to a wideangle, moving objects having positional relationships that may cause thefield of view to be switched are collectively included in the field ofview. Therefore, the same image is captured over a long period of time,thereby facilitating differentiation of relevant moving objects.

When the number of times that the tracking period during which the samemoving object is automatically tracked continuously falls below thelower limit value reaches the lower-limit determination count or higher,the priority monitoring area R2 is enlarged and fixed-point monitoringis performed by the camera device 3. Therefore, in a manner similar tothat according to the first embodiment, the field of view of the cameradevice 3 is fixed, and the situation within the monitoring area can becompletely grasped. For example, the state of movement of the movingobjects, the amount of objects present within the monitoring area, andthe like can be grasped. In addition, because fixed-point monitoring isperformed in a state in which the priority monitoring target is includedin the field of view, the risk of decrease in monitoring performance canbe suppressed.

When the number of times that the tracking target is switched during thedetermination period exceeds the determination upper-limit determined inadvance, the priority monitoring area R2 is enlarged and fixed-pointmonitoring is performed by the camera device 3. Therefore, in a mannersimilar to that according to the first embodiment, the field of view ofthe camera device 3 is fixed, and the situation within the monitoringarea can be completely grasped.

Because the priority monitoring area R2 is set to the overall monitoringarea R1, the overall monitoring area R1 can be monitored even duringfixed-point monitoring. The risk of decrease in monitoring performancecan be suppressed.

The target selector 31 is provided to allow selection of the movingobject to be set as the tracking target. Therefore, the moving objectdesired by the observer can be set as the tracking target withcertainty.

Fourth Embodiment

A control method according a fourth embodiment of the present inventionwill hereinafter be described with reference to FIG. 18. The fourthembodiment differs from the first embodiment in terms of the mode forsetting the tracking target. The configuration of the monitoringapparatus 1 is, the same as that according to the first embodiment.Therefore, the description will be given with reference also to FIG. 1.Detailed descriptions of the processes in the monitoring process shownin FIG. 18 that are the same as those in the monitoring processaccording to the first embodiment shown in FIG. 3 will be omitted.

The monitoring apparatus 1 performs a monitoring process shown in FIG.18. The monitoring apparatus 1 scans the monitoring area R1 using thearea sensor device 2 (E1). The monitoring apparatus 1 detects objectswithin the monitoring area R1 and identifies moving objects (E2). Themonitoring apparatus 1 then sets a tracking target (E3). Here, themonitoring apparatus 1 may set the moving object closest to theentrance/exit G as the tracking target, as according to the firstembodiment. Alternatively, the monitoring apparatus 1 may set the newestmoving object as the tracking target, as according to the secondembodiment. The monitoring apparatus 1 may also set the moving objectswithin the monitoring area R1 in sequence or in a random manner.

Next, the monitoring apparatus 1 determines whether or not a trackingrelease condition is met (E4). According to the present embodiment, inaddition to the above-described determination criterion A anddetermination criterion B, the following determination criteria is setas the tracking release condition.

-   -   Determination criterion C: The response time required until a        moving object newly set as the tracking target is automatically        tracked is longer than the predicted time required for the        moving object newly set as the tracking target to reach the        priority monitoring target.    -   Determination criterion D: The number of identified moving        objects exceeds a moving object upper-limit count determined in        advance. The moving object upper-limit count can be set based on        the size of the monitoring area R1 and the like. For example,        the following can be considered. When it is presumed that the        moving object is a person, the amount of time required for the        person to cross the monitoring area R1 is premised in advance        based on the size of the monitoring area R1 and the walking        speed of the person. The moving object upper-limit count is then        set based on the premised amount of time and the minimum amount        of time required for a single automatic tracking operation.    -   Determination criterion E: A period during which the priority        monitoring target or the priority monitoring area R2 is not        monitored exceeds an unmonitored upper-limit value set in        advance.

When any of the above-described determination criteria A to E is met,the monitoring apparatus 1 determines that the tracking releasecondition is met. Processes for the determination criterion A and thedetermination criterion B are the same as those in the determinationprocess shown in FIG. 4 according to the first embodiment. The processfor the determination criterion C is the same as the process at step C5according to the second embodiment. Detailed descriptions thereof areomitted. In FIG. 18, the process in which the tracking period, thedetermination period, and the variables M and N are initialized isomitted.

With regard to the determination criterion D, when the number of movingobjects identified within the monitoring area R1 exceeds the movingobject upper-limit count, the monitoring apparatus 1 considers thetracking release condition met and releases automatic tracking. A reasonfor this is that, when the moving object upper-limit count is exceeded,it can be expected that frequent switching of the field of view is acertainty. The process for the determination criterion D may beperformed upon identification of the moving objects, that is, after stepE2 and before step E3.

With regard to the determination criterion E, when the period duringwhich the priority monitoring target or the priority monitoring area R2is not monitored exceeds the unmonitored upper-limit value set inadvance, the monitoring apparatus 1 considers the tracking releasecondition met and releases automatic tracking. For example, when a newmoving object is automatically tracked as according to the secondembodiment, the tracking target is switched to a new moving object whena new moving object is identified. Therefore, even when a moving objectthat has been identified earlier infiltrates the priority monitoringarea R2, the moving object is not a tracking target. Therefore, themoving object positioned near the priority monitoring area R2 is notmonitored. In addition, when a new moving object moves withoutapproaching the priority monitoring area R2 (that is, the prioritymonitoring target) as well, the period over which the prioritymonitoring area R2 is not monitored becomes long. Therefore, when theunmonitored upper-limit value is exceeded, the priority monitoring areaR2 is temporarily monitored. As a result, the period over which thepriority monitoring area R2 is not monitored can be prevented frombecoming long.

The monitoring apparatus 1 determines whether or not the trackingrelease condition is met based on the above-described determinationcriteria. When determined that the tracking release condition is not met(NO at E4), the monitoring apparatus 1 automatically tracks the trackingtarget (E5). The monitoring apparatus 1 then proceeds to step E1, andrepeatedly performs the processes to detect objects, identify movingobjects, and set the tracking target.

Meanwhile, when determined that the tracking release condition is met(NO at E4), the monitoring apparatus 1 enlarges the priority monitoringarea R2 as shown in FIG. 9 according to the first embodiment andperforms fixed-point monitoring (E6). The monitoring apparatus 1continues fixed-point monitoring until the fixed-point monitoring periodends (NO at E7, then proceeds to step E1).

In this way, when determined that the tracking release condition is met,the monitoring apparatus 1 enlarges the priority monitoring area R2 andperforms fixed-point monitoring. Therefore, even when a plurality ofmoving objects are present within the monitoring area R1, the vicinityof the entrance/exit G that should preferentially be monitored can bemonitored.

In the control method according to the present embodiment describedabove, the following effects are achieved.

When a plurality of moving objects are identified within the monitoringarea R1, the priority monitoring area is enlarged and fixed-pointmonitoring is performed by the camera device 3 when the tracking releasecondition is met. Therefore, the moving objects present near thepriority monitoring target can be identified. Decrease in monitoringperformance in an area to be preferentially monitored can be prevented.

In addition, the inside of the priority monitoring area R2 is enlargedand imaged. Therefore, the moving objects within the priority monitoringarea R2 can be imaged in an identifiable manner. As a result, even whena plurality of moving objects infiltrate the monitoring area R1, atleast the moving objects within the priority monitoring area R2 desiredby the observer can be monitored.

When the number of times that the tracking period during which the samemoving object is automatically tracked continuously falls below thelower limit value reaches the lower-limit determination count or higher,that is, when the field of view of the camera device 3 is frequentlyswitched before the moving objects are identified, the prioritymonitoring area R2 is enlarged and fixed-point monitoring is performedby the camera device 3. As a result, the field of view of the cameradevice 3 is fixed and the moving objects can be identified.

When the number of times that the tracking target is switched during thedetermination period exceeds the determination upper-limit determined inadvance, that is, when the field of view of the camera device 3 isfrequently switched, the priority monitoring area R2 is enlarged andfixed-point monitoring is performed by the camera device 3. As a result,the field of view of the camera device 3 is fixed and the moving objectscan be identified.

When the response time is longer than the predicted time, the prioritymonitoring area R2 is enlarged and fixed-point monitoring is performedby the camera device 3. Therefore, even in a situation in whichautomatic tracking is delayed, in a manner similar to that according tothe first embodiment, at least the moving objects positioned in alocation to be preferentially monitored can be imaged.

When the number of moving objects present in the monitoring area R1exceeds the moving object upper-limit count, the priority monitoringarea R2 is enlarged and fixed-point monitoring is performed by thecamera device 3. Therefore, even in a situation in which automatictracking is delayed, in a manner similar to that according to the firstembodiment, at least the moving objects positioned in a location to bepreferentially monitored can be imaged.

When the period over which the priority monitoring area R2 is notmonitored exceeds the unmonitored upper-limit value, the prioritymonitoring area R2 is enlarged and fixed-point monitoring is performedby the camera device 3. Therefore, a situation in which the period overwhich the priority monitoring target or the priority monitoring area R2is not monitored becomes long and the monitoring state deteriorates canbe prevented. As a result, for example, when an object that is in astationary state (if the object is a person, the stationary stateincludes when the person is moving his/her hands, for example, but isnot moving position) within the monitoring area R1 and is temporarilyeliminated from the tracking target as being “not a moving object” ispresent near the priority monitoring target or the priority monitoringarea R1, the priority monitoring target or the priority monitoring areaR2 can be monitored.

Other Embodiments

The present invention is not limited to the examples according to theembodiments. For example, the present invention can be modified orexpanded as below.

The numerical values given according to the embodiments are examples.The present invention is not limited thereto.

When objects are detected, the objects may be detected and the movingobjects may be identified based on data obtained from a plurality ofscanning operations rather than a single scanning operation.

To simplify the description, a process flow in which the monitoringapparatus 1 stands by during the fixed-point monitoring period is givenas an example according to the embodiments. However, the monitoringapparatus 1 performs detection of objects and identification of movingobjects even during the fixed-point monitoring period. When thefixed-point monitoring period elapses, the monitoring apparatus 1automatically tracks the moving objects identified during thefixed-point monitoring period.

When confirmation by the observer is required, the same moving object isrequired to be continuously imaged for about two seconds. However, whenthe monitoring unit 4 is configured to be provided with a storage unitand capable of reproducing captured images, the period over which thesame moving object is imaged can be shortened. The moving object can beconfirmed at a later time. Therefore, the response time and the trackingperiod can be set as appropriate based on the configuration of themonitoring apparatus 1 and the like.

The determination criteria A to E may be combined in any manner. Thatis, the determination criteria A and B are used according to the firstembodiment. However, the determination criteria C to E may be used.Alternatively, the determination criterion D may be used, andfixed-point monitoring may be performed when the number of movingobjects is large. The determination criteria A to E may also besimilarly combined in any manner for the second embodiment and the thirdembodiment.

According to the embodiments, the moving objects identified within themonitoring area include moving objects that have stopped within themonitoring area and have temporarily been determined to be “not a movingobject”, but have subsequently resumed movement.

REFERENCE SIGN LIST

In the drawings, a reference number 1 shows a monitoring apparatus, areference 2 shows an area sensor device (optical distance meter), and areference number 3 shows a camera device.

1. (canceled)
 2. A method of monitoring a moving object within apredetermined monitoring area, wherein the method comprises steps of:detecting objects by scanning the monitoring area by an optical distancemeter; identifying moving objects among the detected objects; setting,as a tracking target being tracked, among the identified moving objects,a moving object closest to a priority monitoring object which is presetin the monitoring area; and automatically tracking, using a cameradevice, the moving object which is set to the tracking target, wherein,when a count showing that a tracking period becomes lower sequentiallythan a lower limit value becomes larger than a lower determinationcount, the same moving object being automatically tracked during thetracking period, a preset priority monitoring area including thepriority monitoring object is enlarged for fixed-point monitoringperformed by the camera device.
 3. A method of monitoring a movingobject within a predetermined monitoring area, wherein the methodcomprises steps of: detecting objects by scanning the monitoring area byan optical distance meter; identifying moving objects among the detectedobjects; setting, as a tracking target being tracked, among theidentified moving objects, a moving object closest to a prioritymonitoring object which is preset in the monitoring area; andautomatically tracking, using a camera device, the moving object whichis set to the tracking target, wherein, when a count showing that thetracking target has been switched to other tracking targets in apredetermined determination period has exceeded a predetermined upperdetermination count, a priority monitoring area including the prioritymonitoring object is enlarged for fixed-point monitoring performed bythe camera device.
 4. The method of claim 3, wherein, when a countshowing that a tracking period becomes lower sequentially than a lowerlimit value becomes larger than a lower determination count, the samemoving object being automatically tracked during the tracking period, apreset priority monitoring area including the priority monitoring objectis enlarged for fixed-point monitoring performed by the camera device.5. The method of claim 2, wherein the priority monitoring area is set tobe an area in which, at least, a plurality of the moving objects areable be imaged.
 6. A method of monitoring a moving object within apredetermined monitoring area, wherein the method comprises steps of:detecting objects by scanning the monitoring area by an optical distancemeter; identifying moving objects among the detected objects; setting,as a tracking target being tracked, among the identified moving objects,a moving object closest to a priority monitoring object which is presetin the monitoring area; automatically tracking, using a camera device,the moving object which is set to the tracking target; determiningwhether or not a plurality of the moving objects are identified in themonitoring area; determining whether or not a predetermined trackingrelease condition, which is set for releasing the automatic trackingusing the camera device has been met when it is determined that theplurality of the moving objects are identified in the monitoring area;and monitoring, in fixed-point monitoring, preset priority monitoringareas including the priority monitoring object present in the monitoringarea at a wide angle with use of the camera device, when it isdetermined that the tracking release condition is met.
 7. The method ofclaim 2, wherein the method comprises steps of: determining whether ornot a plurality of the moving objects are identified in the monitoringarea, determining whether or not a predetermined tracking releasecondition, which is set for releasing the automatic tracking using thecamera device has been met when it is determined that the plurality ofthe moving objects are identified in the monitoring area, and enlargingand monitoring, in fixed-point monitoring, preset priority monitoringareas including the priority monitoring object present in the monitoringarea with use of the camera device, when it is determined that thetracking release condition is met.
 8. The method of claim 6 wherein thetracking release condition is set such that a count showing that atracking period becomes lower sequentially than a lower limit valuebecomes larger than a lower determination count, the same moving objectbeing automatically tracked during the tracking period.
 9. The method ofclaim 6, wherein the tracking release condition is set such that a countshowing that the tracking target has been switched to other trackingtargets in a predetermined determination period has exceeded apredetermined upper determination count.
 10. The method of claim 6,wherein the whole monitoring area is set as the priority monitoringarea.
 11. The method of claim 6, wherein the tracking release conditionis set such that a response time required to automatically track amoving object newly set as a tracking target is longer than a predictedtime necessary for the newly set moving object to reach the prioritymonitoring object.
 12. The method of claim 6, wherein the trackingrelease condition is set such that the number of identified movingobjects exceeds a predetermined upper number.
 13. The method of claim 6,wherein the tracking release condition is set such a period of timeduring which the priority monitoring object or the priority monitoringarea is not continuously monitored is over a predetermined upper limit.14. The method of claim 6, wherein the priority monitoring area is setas an area in which, at least, a plurality of the moving objects areable to be imaged.
 15. The method of claim 6, wherein the fixed-pointmonitoring step is set such that when the priority monitoring area ispositionally fixedly monitored at a wide view using the camera deviceand, during the monitoring, any of the moving objects in the prioritymonitoring area is selected, the selected moving object is set to thetracking target and automatically tracked.
 16. A method of monitoring amoving object, by which a monitoring area is scanned by an opticaldistance meter to detect moving objects, a moving object is identifiedamong the detected moving objects, and the identified moving object isset to a tracking target for automatic tracking by a camera device, themethod is wherein when a plurality of the moving objects are identifiedin the monitoring area and it is determined that a tracking releasecondition is met which is preset for releasing the automatic trackingperformed using the camera device, the camera device monitors, infixed-point monitoring, a priority monitoring area at a wide view angle,the priority monitoring area being preset in the monitoring area tocontain a priority monitoring object present in the monitoring area. 17.An apparatus for monitoring a moving object in a preset monitoring area,wherein the apparatus comprises means for detecting objects by scanningthe monitoring area using an optical distance meter; means foridentifying moving objects among the detected objects; means forsetting, as a tracking target, among the specified moving objects, amoving object which is the closest to a priority monitoring object whichis preset in the monitoring area; and means for automatically trackingthe moving object which is set as the tracking target beingautomatically tracked, by an camera apparatus; and means for, when acount showing that a tracking period becomes lower sequentially than alower limit value becomes larger than a lower determination count, thesame moving object being automatically tracked during the trackingperiod, i) enlarging a preset priority monitoring area including thepriority monitoring object and ii) performing fixed-point monitoring ofthe priority monitoring area using by the camera device.